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Amendments to the Claims 

Please amend Claims 1, 10, 15, 17-29, 32, 38, 43, 45-54, 59, 61-66, 71, 74. The Claim 
Listing below will replace all prior versions of the claims in the application: 

Claim Listing 

1 . (Currently amended) A method for synthesizing a data sequence representing figure or 
human motion , comprising computer implemented steps of : 

defining a switching linear dynamic system (SLDS) comprising a plurality of 
dynamic models; 

associating each model with a switching state such that a model is selected when 
its associated switching state is true; 

determining a state transition record for at least one training sequence of 
measurements by determining and recording, for a given measurement and for each 
possible switching state, an optimal prior switching state, based on the at least one 
training sequence, wherein the optimal prior switching state optimizes a transition 
probability; 

determining, for a final measurement, an optimal final switching state; 

determining the sequence of switching states by backtracking, fi:om said optimal 
final switching state, through the state transition record; 

learning parameters of the dynamic models, responsive to the determined 
sequence of switching states; and 

synthesizing a new data sequence, based on the dynamic models with learned 
parameters. 

2. (Original) The method of Claim 1, wherein the new data sequence has characteristics 
which are similar to characteristics of at least one training sequence. 

3. (Original) The method of Claim 1 , wherein the new data sequence combines 
characteristics of plural training sequences. 
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4. (Original) The method of Claim 1, further comprising modifying the SLDS such that at 
least one constraint is met. 

5. (Original) The method of Claim 4, wherein modifying the SLDS comprises: 
adding a continuous state control 

6. (Original) The method of Claim 5, wherein modifying the SLDS further comprises: 

adding constraints on continuous states. 

7. (Original) The method of Claim 5, wherein modifying the SLDS further comprises: 

adding constraints on the continuous state control. 

8. (Original) The method of Claim 5, wherein modifying the SLDS further comprises: 

adding constraints on time. 

9. (Original) The method of Claim 5, further comprising: 

designing an optimal continuous control that satisfies the at least one constraint. 

10. (Currently amended) The method of Claim 9, further comprising: 

synthesizing the new data sequence using the optimal continuous control. 

1 1 . (Original) The method of Claim 4, wherein modifying the SLDS comprises: 

adding a switching state control. 

12. (Original) The method of Claim 11, wherein modifying the SLDS further comprises: 

adding constraints on switching states. 



13. 



(Original) The method of Claim 12, wherein modifying the SLDS further comprises: 
adding constraints on the switching state control. 
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14. (Original) The method of Claim 12, further comprising: 

designing an optimal switching control that satisfies constraints. 

15. (Currently amended) The method of Claim 14, further comprising: 

synthesizing the new data sequence using the optimal switching control 

16. (Original) The method of Claim 4, further comprising designing optimal switching and 
continuous state controls that satisfy continuous and switching constraints respectively. 

17. (Currently amended) The method of Claim 16, further comprising: 

synthesizing the new data sequence using the optimal switching and continuous 
state controls. 

18. (Currently amended) The method of Claim 1 , wherein the training sequence of 
measurements comprises economic data. 

19. (Currently amended) The method of Claim 1 , wherein the training sequence of 
measurements comprises image data. 

20. (Currently amended) The method of Claim 1 , wherein the training sequence of 
measurements comprises audio data. 

2 1 . (Currently amended) The method of Claim 1 , wherein the training sequence of 
measurements comprises spatial data. 

22. (Currently amended) Computer apparatus for synthesizing figure motion using a [ [A] ] 
switching linear dynamic system (SLDS) model, mid comprising: 

a plurality of linear dynamic system (LDS) models, wherein at any given instance, 
an LDS model is selected responsive to a switching variable; 
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a state transition recorder which determines, for at least one training sequence of 
measurements, a state transition record by determining and recording, for a given 
measurement and for each possible switching state, an optimal prior switching state, 
based on the at least one training sequence, wherein the optimal prior switching state 
optimizes a transition probability, and which determines, for a final measurement, an 
optimal final switching state; 

a backtracker which determines a sequence of switching states corresponding to 
the training sequence by backtracking, from said optimal final switching state, through 
the state transition record; 

a dynamic model learner which learns parameters of the dynamic models 
responsive to the determined sequence of sv^tching states; and 

a synthesizer which synthesizes a new data sequence, based on dynamic models 
with learned parameters. 

23. (Currently amended) Th e SLDS model Computer apparatus of Claim 22, wherein the new 
data sequence has characteristics similar to at least one training sequence. 

24. (Currently amended) Th e SLDS model Computer apparatus of Claim 22, wherein the new 
data sequence combines characteristics of plural training sequences. 

25. (Currently amended) A computer system for synthesizing a data sequence representing 
figure or human motion , comprising: 

means for defining a switching linear dynamic system (SLDS) comprising a 
plurality of dynamic models; 

means for associating each model with a switching state such that a model is 
selected when its associated switching state is true; 

means for determining a state transition record for at least one training sequence 
of measurements by determining and recording, for a given measurement and for each 
possible switching state, an optimal prior switching state, based on the at least one 



training sequence, wherein the optimal prior switching state optimizes a transition 
probability; 

means for determining, for a final measurement, an optimal final switching state; 

means for determining the sequence of switching states by backtracking, from said 
optimal final switching state, through the state transition record; 

means for learning parameters of the dynamic models, responsive to the 
determined sequence of switching states; and 

means for synthesizing a new data sequence, based on the dynamic models with 
learned parameters. 

(Currently amended) A computer program product for synthesizing a data sequence 
representing figure or human motion , the computer program product comprising a 
computer usable medium having computer readable code thereon, including program 
code which: 

defines a switching linear dynamic system (SLDS) comprising a plurality of 
dynamic models; 

associates each model with a switching state such that a model is selected when its 
associated switching state is true; 

determines a state transition record for at least one training sequence of 
measurements by determining and recording, for a given measurement and for each 
possible switching state, an optimal prior switching state, based on the at least one 
training sequence, wherein the optimal prior switching state optimizes a transition 
probability; 

determines an optimal final switching state for a final measurement; and 

determines the sequence of switching states by backtracking, from said optimal 
final switching state, through the state transition record; 

leams parameters of the dynamic models, responsive to the determined sequence 
of switching states; and 

synthesizes a new data sequence, based on the dynamic models with learned 
parameters. 
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27. (Currently amended) A computer system for performing motion synthesis and 
interpolation comprising: 

a processor; 

a memory system connected to the processor; and 
a computer program, in the memory, which: 

associates each of a plurality of dynamic models with a switching state such that a 
model is selected when its associated switching state is true; 

determines a state transition record for at least one training sequence of 
measurements by determining and recording, for a given measurement and for each 
possible switching state, an optimal prior switching state, based on the at least one 
training sequence, wherein the optimal prior switching state optimizes a transition 
probability; 

determines an optimal final switching state for a final measurement; and 

determines the sequence of switching states by backtracking, from said optimal 
final switching state, through the state transition record; 

leams parameters of the dynamic models, responsive to the determined sequence 
of switching states; and 

synthesizes a new data sequence, based on the dynamic models with learned 
parameters, 

28. (Currently amended) A computer program product comprising computer data signal 
embodied in a carrier wave for synthesizing a data sequence representing figure motion , 
comprising: 

program code for associating each [[model]] of a plurality of dynamic models 
with a switching state such that a model is selected when its associated switching state is 
true; 

program code for determining a state transition record for at least one training 
sequence of measurements by determining and recording, for a given measurement and 
for each possible switching state, an optimal prior switching state, based on the at least 



one training sequence, wherein the optimal prior switching state optimizes a transition 
probability; 

program code for determining, for a final measurement, an optimal final switching 

state; 

program code for determining the sequence of switching states by backtracking, 
from said optimal final switching state, through the state transition record; and 

program code for learning parameters of the dynamic models, responsive to the 
determined sequence of switching states; and 

program code for synthesizing a new data sequence, based on the dynamic models 
with learned parameters. 

(Currently amended) A method for synthesizing a data sequence representing figure 
motion, comprising computer implemented steps of : 

defining a switching linear dynamic system (SLDS) comprising a plurality of 
dynamic models; 

associating each dynamic model with a switching state such that a dynamic model 
is selected when its associated switching state is true, wherein the switching state at a 
particular instance is determined by a switching model; 

decoupling the dynamic models from the switching model; 

determining parameters of a decoupled dynamic model, responsive to a switching 
state probability estimate; 

estimating a state of a decoupled dynamic model corresponding to a measurement 
at the particular instance, and responsive to at least one training sequence of 
measurements; 

determining parameters of the decoupled switching model, responsive to the 
dynamic state estimate; 

estimating a probability for each possible switching state of the decoupled 
switching model; 

determining a switching state sequence based on the estimated switching state 
probabilities; 
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leaming parameters of the dynamic models, responsive to the switching states 
sequence; and 

synthesizing a new data sequence, based on the dynamic models with learned 
parameters. 

30. (Original) The method of Claim 29, wherein the new data sequence has characteristics 
similar to at least one training sequence. 

3 1 . (Original) The method of Claim 29, wherein the new data sequence combines 
characteristics of plural training sequences. 

32. (Currently amended) The method of Claim [[32]] 29, further comprising modifying the 
SLDS such that at least one constraint is met. 

33. (Original) The method of Claim 32, wherein modifying the SLDS comprises: 

adding a continuous state control. 

34. (Original) The method of Claim 33, wherein modifying the SLDS further comprises: 

adding constraints on continuous states. 

35. (Original) The method of Claim 33, wherein modifying the SLDS further comprises: 

adding constraints on the continuous state control. 

36. (Original) The method of Claim 33, wherein modifying the SLDS further comprises: 

adding constraints on time. 

37. (Original) The method of Claim 33, further comprising: 

designing an optimal continuous control that satisfies the at least one constraint. 
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38. (Currently amended) The method of Claim 37, further comprising: 

synthesizing the new data sequence using the optimal continuous control. 

39. (Original) The method of Claim 32, wherein modifying the SLDS comprises: 

adding a switching state control. 

40. (Original) The method of Claim 39, wherein modifying the SLDS further comprises: 

adding constraints on switching states. 

41 . (Original) The method of Claim 40, wherein modifying the SLDS further comprises: 

adding constraints on the switching state control. 

42. (Original) The method of Claim 40, further comprising: 

designing an optimal switching control that satisfies constraints. 

43. (Currently amended) The method of Claim 42, further comprising: 

synthesizing the new data sequence using the optimal switching control. 

44. (Original) The method of Claim 32, further comprising designing optimal switching and 
continuous state controls that satisfy continuous and switching constraints respectively. 

45. (Currently amended) The method of Claim 44, further comprising: 

synthesizing the new data sequence using the optimal switching and continuous 
state controls. 

46. (Currently amended) Computer apparatus for motion synthesis and interpolation using a 
[[A]] switching linear dynamic system (SLDS) model, comprising: 

a plurality of linear dynamic system (LDS) models, wherein at any given instance, 
an LDS model is selected responsive to a switching variable; 

a switching model which determines values of the sv^tching variable; 
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an approximate variational state sequence inference module, which reestimates 
parameters of each LDS model, using variational inference, to minimize a modeling cost 
of current state sequence estimates, responsive to at least one training sequence of 
measurements; and 

a synthesizer which synthesizes a new data sequence, based on the reestimated 
dynamic models. 

47. (Currently amended) The SLDS model Computer apparatus of Claim 46, wherein the new 
data sequence has characteristics similar to the at least one training sequence. 

48. (Currently amended) Th e SLDS model Computer apparatus of Claim 46, wherein the new 
data sequence combines characteristics of plural training sequences. 

49. (Currently amended) The method Computer apparatus of Claim 46, further comprising 
modifying the SLDS such that at least one constraint is met. 

50. (Currently amended) The method Computer apparatus of Claim 49, wherein modifying 
the SLDS comprises: 

adding a continuous state control. 

5 1 . (Currently amended) The method Computer apparatus of Claim 49, wherein modifying 
the SLDS comprises: 

adding a switching state control. 

52. (Currently amended) Th e method Computer apparatus of Claim 49, further comprising 
designing optimal switching and continuous state controls that satisfy continuous and 
switching constraints respectively. 
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53. (Currently amended) Th e m e thod Computer apparatus of Claim 52, further comprising: 
synthesizing the new data sequence using the optimal switching and continuous 
state controls. 



54. (Currently amended) A method for synthesizing figure motion by interpolating from an 
input measurement sequence, comprising computer implemented steps of : 

defining a switching linear dynamic system (SLDS) comprising a plurality of 
dynamic models; 

associating each model with a switching state such that a model is selected when 
its associated switching state is true; 

determining a state transition record by determining and recording, for a given 
measurement and for each possible switching state, an optimal prior switching state, 
based on at least one training measurement sequence, wherein the optimal prior switching 
state optimizes a transition probability; 

determining, for a final measurement, an optimal final switching state; 

determining the sequence of switching states by backtracking, from said optimal 
final switching state, through the state transition record; 

determining the sequence of continuous states based on the determined sequence 
of switching states; and 

interpolating missing motion data from the input sequence, based on dynamic 
models and responsive to the determined sequences of continuous and switching states. 

55. (Original) The method of Claim 54, fiirther comprising modifying the SLDS such that at 
least one constraint is met. 

56. (Original) The method of Claim 55, wherein modifying the SLDS comprises: 

adding a continuous state control. 

57. (Original) The method of Claim 55, wherein modifying the SLDS comprises: 

adding a switching state control. 
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58. (Original) The method of Claim 55, further comprising designing optimal switching and 
continuous state controls that satisfy continuous and switching constraints respectively. 



59. (Currently amended) The method of Claim 58, further comprising: 

interpolating the new data sequence using the optimal switching and continuous 
state controls. 



60. (Original) The method of Claim 54, further comprising: 

at a receiver, interpolating missing frames from transmitted model parameters and 
from received key frames, the key frames having been determined based on the learned 
parameters, wherein the input measurement sequence comprises the received key frames. 

6 1 . (Currently amended) Computer apparatus for motion svnthesis and interpolation using a 
[[A]] switching linear dynamic system (SLDS) model, comprising: 

a plurality of linear dynamic system (LDS) models, wherein at any given instance, 
an LDS model is selected responsive to a switching variable; 

a state transition recorder which determines a state transition record for a training 
measurement sequence by determining and recording, for a given measurement and for 
each possible switching state, an optimal prior switching state, based on the training 
sequence, wherein the optimal prior switching state optimizes a transition probability, and 
which determines, for a final measurement, an optimal final switching state; 

a backtracer which determines a sequence of switching states corresponding to the 
training sequence by backtracking, from said optimal final switching state, through the 
state transition record; 

a dynamic model learner which learns parameters of the dynamic models 
responsive to the determined sequence of switching states; and 

an interpolator which interpolates missing motion data from [[the]] an input 
sequence, based on the dynamic models with learned parameters. 
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62. (Currently amended) A computer system for synthesizing figure motion by interpolating 
from an input measurement sequence, the system comprising: 

means for defining a switching linear dynamic system (SLDS) comprising a 
plurality of dynamic models; 

means for associating each model with a switching state such that a model is 
selected when its associated switching state is true; 

means for determining a state transition record by determining and recording, for a 
giyen measurement and for each possible switching state, an optimal prior switching 
state, based on at least one training sequence, wherein the optimal prior switching state 
optimizes a transition probability; 

means for determining, for a final measurement, an optimal final switching state; 

means for determining the sequence of switching states by backtracking, from said 
optimal final switching state, through the state transition record; 

means for learning parameters of the dynamic models, responsive to the 
determined sequence of switching states; and 

means for interpolating missing motion data fi:om the input sequence, based on 
dynamic models learned firom training sequences. 

63. (Currently amended) A computer program product for synthesizing figure motion by 
interpolating from an input measurement sequence, the computer program product 
comprising a computer usable medium having computer readable code thereon, including 
program code which: 

associates each [[model]] of a plurality of dynamic models with a switching state 
such that a model is selected when its associated switching state is true; 

determines a state transition record by determining and recording, for a given 
measurement and for each possible switching state, an optimal prior switching state, 
based on at least one training measurement sequence, wherein the optimal prior switching 
state optimizes a transition probability; 

determines an optimal final switching state for a final measurement; and 
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determines the sequence of switching states by backtracking, from said optimal 
final switching state, through the state transition record; 

learns parameters of the dynamic models, responsive to the determined sequence 
of switching states resulting; and 

interpolates missing motion data from the input sequence, based on the dynamic 
models with learned parameters. 

64. (Currently amended) A computer system for motion synthesis and interpolation 
comprising: 

a processor; 

a memory system connected to the processor; and 
a computer program, in the memory, which: 

associates each of a plurality of dynamic models with a switching state such that a 
model is selected when its associated switching state is true; 

determines, from a set of possible switching states and responsive to a training 
sequence of measurements, a state transition record by determining and recording, for a 
given measurement and for each possible switching state, an optimal prior switching 
state, wherein the optimal prior switching state optimizes a transition probability; 

determines an optimal final switching state for a final measurement; 

determines a sequence of switching states corresponding to the measurement 
sequence by backtracking, from said optimal final switching state, through the state 
transition record; 

learns parameters of the dynamic models, responsive to the determined sequence 
of switching states; and 

interpolates missing motion data from an input sequence, based on the dynamic 
models with learned parameters. 

65. (Currently amended) A computer program product comprising a computer data signal 
embodied in a carrier wave for synthesizing motion bv interpolating from an input 
measurement sequence, comprising: 
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program code for associating each [[model]] of a plurality of dynamic models 
with a switching state such that a model is selected when its associated switching state is 
true; 

program code for determining a state transition record by determining and 
recording, for a given measurement of at least one training sequence and for each possible 
switching state, an optimal prior switching state, based on the at least one training 
sequence, wherein the optimal prior switching state optimizes a transition probability; 

program code for determining, for a final measurement, an optimal final switching 

state; 

program code for determining the sequence of switching states by backtracking, 
from said optimal final switching state, through the state transition record; and 

program code for learning parameters of the dynamic models, responsive to the 
determined sequence of switching states; and 

program code for interpolating missing data from an input sequence, based on the 
dynamic models with learned parameters. 

(Currently amended) A method for synthesizing motion by interpolating from an input 
measurement sequence, comprising computer implemented steps of : 

defining a switching linear dynamic system (SLDS) comprising a plurality of 
dynamic models; 

associating each dynamic model with a switching state such that a dynamic model 
is selected when its associated switching state is true, wherein the switching state at a 
particular instance is determined by a switching model; 

decoupling the dynamic models from the switching model; 

determining parameters of a decoupled dynamic model, responsive to a switching 
state probability estimate; 

estimating a state of a decoupled dynamic model corresponding to a measurement 
at the particular instance, and responsive to at least one training sequence of 
measurements; 
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determining parameters of the decoupled switching model, responsive to the 
dynamic state estimate; 

estimating a probability for each possible switching state of the decoupled 
switching model; and 

determining the sequence of switching states based on the estimated switching 
state probabilities; 

learning parameters of the dynamic models, responsive to the determined 
sequence of switching states; and 

interpolating missing motion data from the input sequence, based on the dynamic 
models with learned parameters. 

67. (Original) The method of Claim 66, further comprising modifying the SLDS such that at 
least one constraint is met. 

68. (Original) The method of Claim 67, wherein modifying the SLDS comprises: 

adding a continuous state control. 

69. (Original) The method of Claim 67, wherein modifying the SLDS comprises: 

adding a switching state control. 

70. (Original) The method of Claim 67, further comprising designing optimal switching and 
continuous state controls that satisfy continuous and switching constraints respectively. 

71 . (Currently amended) The method of Claim 70, further comprising: 

synthesizing the new data sequence using the optimal switching and continuous 
state controls. 



72. (Original) The method of Claim 66, wherein the measurement sequence comprises a 
sparsely observed image sequence. 
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73. (Original) The method of Claim 66, further comprising: 

at a receiver, interpolating missing frames from transmitted model parameters and 
from received key frames, the key frames having been determined based on the learned 
parameters. 

74. (Currently amended) Computer apparatus for motion synthesis and interpolation using a 
[[A]] switching linear dynamic system (SLDS) model, comprising: 

a plurality of linear dynamic system (LDS) models, wherein at any given instance, 
an LDS model is selected responsive to a switching variable; 

a switching model which determines values of the switching variable; 

an approximate variational state sequence inference module, which reestimates 
parameters of each SLDS model, using variational inference, to minimize a modeling cost 
of current state sequence estimates; 

a dynamic model learner which learns parameters of the dynamic models 
responsive to the determined sequence of switching states resulting from at least one 
training sequence; and 

an interpolator which interpolates missing motion data from an input sequence, 
based on the dynamic models with learned parameters. 



